Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research
نویسندگان
چکیده
منابع مشابه
Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research
Amazon Mechanical Turk (AMT) is an online crowdsourcing service where anonymous online workers complete web-based tasks for small sums of money. The service has attracted attention from experimental psychologists interested in gathering human subject data more efficiently. However, relative to traditional laboratory studies, many aspects of the testing environment are not under the experimenter...
متن کاملEvaluating Online Labor Markets for Experimental Research: Amazon.com’s Mechanical Turk
We examine the trade-offs associated with using Amazon.com’s Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first ...
متن کاملConducting behavioral research on Amazon's Mechanical Turk.
Amazon's Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this article is to demonstrate how to use this Web site for conducting behavioral research and to lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of resea...
متن کاملAmazon Mechanical Turk: A Research Tool for Organizations and Information Systems Scholars
Amazon Mechanical Turk (AMT), a system for crowdsourcing work, has been used in many academic fields to support research and could be similarly useful for information systems research. This paper briefly describes the functioning of the AMT system and presents a simple typology of research data collected using AMT. For each kind of data, it discusses potential threats to reliability and validit...
متن کاملEvaluating Crowdsourcing through Amazon Mechanical Turk as a Technique for Conducting Music Perception Experiments
Online crowdsourcing marketplaces, such as the Amazon Mechanical Turk, provide an environment for cost-effective crowdsourcing on a massive scale, leveraging human intelligence, expertise, and judgment. While the Mechanical Turk is typically used by businesses to clean data, categorize items, and moderate content, the scientific community, too, has begun experimenting with it to conduct academi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: PLoS ONE
سال: 2013
ISSN: 1932-6203
DOI: 10.1371/journal.pone.0057410